Create Job Templates

The ease of working in Lazsa Data Pipeline Studio is the availability of templates. The Platform supports around 25+ data technologies and provides 30+ predefined templates that cover most of the processes like data ingestion from multiple sources, data integration, transformation, data quality right up to data visualization. Apart from the technologies and features that are currently supported, you can extend the functionality or integrate new technologies to the Lazsa Platform. The simplest way of doing this is by creating new templates.

Process to add new templates

These are the high-level steps that you must perform to create and add new templates to Data Pipeline Studio to add new functionality.

Add a new entry into the lazsa_templates file in entry method.
Create a new file for a new flow. The naming convention to be followed is: {source_name}_{target_name}_{Operation}.py
Use utilities from the core common utlis package if required, or create a new one.

Process to add new library dependency

You must add to the setup file along with the version details, any new libraries that you may be using for extending the functionality.

Following is the sample code for the setup file: